AWS Pyspark Developer

AWS Pyspark Developer

What’s on Offer:

• Industry: Consulting
  
  
• Location: Singapore
  
  
• 12 months contract role (with the possibility of extension)
  
  
• Competitive Compensation

Job Description:

• Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems.

• Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda).

• Optimize data workflows for performance and reliability.

• Collaborate with data engineers, analysts, and business stakeholders to deliver high-quality
  solutions.

• Ensure data security and compliance with organizational standards.

Job Requirements:

• AWS: Hands-on experience with core AWS services for data engineering.
• Python: Strong programming skills for data processing and automation.
• PySpark: Expertise in distributed data processing and Spark framework.
• SQL: Proficiency in writing complex queries and optimizing performance

Good to Have:

• Databricks: Experience with Databricks platform for big data analytics.
• Knowledge of CI/CD pipelines and DevOps practices.
• Familiarity with data lake and data warehouse concepts.